An Immersive Surgery Training System With Live Streaming Capability
نویسندگان
چکیده
Providing real-time, interactive immersive surgical training has been a key research area in telemedicine. Earlier approaches have mainly adopted videotaped training that can only show imagery from a fixed view point. Recent advances on commodity 3D imaging have enabled a new paradigm for immersive surgical training by acquiring nearly complete 3D reconstructions of actual surgical procedures. However, unlike 2D videotaping that can easily stream data in real-time, by far 3D imaging based solutions require pre-capturing and processing the data; surgical trainings using the data have to be conducted offline after the acquisition. In this paper, we present a new real-time immersive 3D surgical training system. Our solution builds upon the recent multi-Kinect based surgical training system [1] that can acquire and display high delity 3D surgical procedures using only a small number of Microsoft Kinect sensors. We build on top of the system a client-server model for real-time streaming. On the server front, we efficiently fuse multiple Kinect data acquired from different viewpoints and compress and then stream the data to the client. On the client front, we build an interactive space-time navigator to allow remote users (e.g., trainees) to witness the surgical procedure in real-time as if they were present in the room.
منابع مشابه
WorldViews: Connecting the world through easy sharing of views
The confluence of technologies such as telepresence, immersive imaging, model based virtual mirror worlds, mobile live streaming, etc. give rise to a capability for people anywhere to view and connect with present or past events nearly anywhere on earth. This capability properly belongs to a public commons, available as a birthright of all humans, and can been seen as part of an evolutionary tr...
متن کاملSoftware Chroma Keying in an Immersive Virtual Environment
This paper presents a very fast software chroma keying algorithm, requiring at most five integer operations per pixel. An improvement of more than 300% in performance over HLS based algorithms was achieved. The algorithm has been developed for use in an immersive virtual environment, which is also described here.
متن کاملExperimental Investigation of Audio and Video Quality in Multi - Video Streaming Environments
This work addresses the problems of sending live media, in the form of audio and video over heterogenous networks. Specifically we address streaming multiple video streams in a wireless network and streaming audio in a multi-video tele-immersive environment. In the wireless domain, we explore the use of a user level Bandwidth Manager as QoS control to aid the transfer of adaptive video. We impl...
متن کاملImmersive Group Telepresence and the Perception of Eye Contact
Parameters of an immersive telepresence audio/visual system was first defined by a review of the literature and also a preliminary qualitative analysis with live subjects. The definition that emerged was drawn upon as criteria for the audio/visual design and equipment installation used for the present experiment. The definition is simulating a conferencing image of a person sitting on the other...
متن کاملCultural Respect Encompassing Simulation Training: Being Heard About Health Through Broadband
BACKGROUND Cultural Respect Encompassing Simulation Training (CREST) is a learning program that uses simulation to provide health professional students and practitioners with strategies to communicate sensitively with culturally and linguistically diverse (CALD) patients. It consists of training modules with a cultural competency evaluation framework and CALD simulated patients to interact with...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Studies in health technology and informatics
دوره 196 شماره
صفحات -
تاریخ انتشار 2014